A random matrix approach to neural networks
نویسندگان
چکیده
منابع مشابه
A Random Matrix Approach to Neural Networks
R n×p is a matrix of independent zero-mean unit variance entries, and σ : R → R is a Lipschitz continuous (activation) function — σ(WX) being understood entry-wise. We prove that, as n, p, T grow large at the same rate, the resolvent Q = (G + γIT ) , for γ > 0, has a similar behavior as that met in sample covariance matrix models, involving notably the moment Φ = T n E[G], which provides in pas...
متن کاملA Random Matrix Approach to Echo-State Neural Networks
Recurrent neural networks, especially in their linear version, have provided many qualitative insights on their performance under different configurations. This article provides, through a novel random matrix framework, the quantitative counterpart of these performance results, specifically in the case of echo-state networks. Beyond mere insights, our approach conveys a deeper understanding on ...
متن کاملA Random Matrix Approach to Manipulator Jacobian
Traditional kinematic analysis of manipulators, built upon a deterministic articulated kinematic modeling often proves inadequate to capture uncertainties affecting the performance of the real robotic systems. While a probabilistic framework is necessary to characterize the system response variability, the random variable/vector based approaches are unable to effectively and efficiently charact...
متن کاملA Random Matrix Approach to Credit Risk
We estimate generic statistical properties of a structural credit risk model by considering an ensemble of correlation matrices. This ensemble is set up by Random Matrix Theory. We demonstrate analytically that the presence of correlations severely limits the effect of diversification in a credit portfolio if the correlations are not identically zero. The existence of correlations alters the ta...
متن کاملA Random Matrix Approach to Language Acquisition
Since language is tied to cognition, we expect the linguistic structures to reflect patterns we encounter in nature and analyzed by physics. Within this realm we investigate the process of protolanguage acquisition, using analytical and tractable methods developed within physics. A protolanguage is a mapping between sounds and objects (or concepts) of the perceived world. This mapping is repres...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: The Annals of Applied Probability
سال: 2018
ISSN: 1050-5164
DOI: 10.1214/17-aap1328